International Journal of New Technology and Research (IJNTR) 
ISSN:2454-4116, Yolume-2, Issue-6, June 2016 Pages 95-100 


Prediction of Manufacturing System Using Improved 
Infomax Method Based on Poor Information 

Xintao Xia, Wenhuan Zhu, Bin Liu 


Abstract — The improved infomax method consists of the 
bootstrap methodology, the grey system theory, and the 
information entropy theory. The bootstrap methodology is 
adopted to imitate the generated information vector of large size 
by bootstrap resampling from the current information vector of 
small size, the grey system theory is used to introduce the 
generated information vector into the grey prediction model for 
forecasting the future information vector of large size, and the 
information entropy theory is employed to predict a probability 
distribution of the future information via the maximum entropy 
criterion. Information prediction of a manufacturing system is 
put into practice under the condition of poor information. Case 
studies of the diameter and roundness of a tapered rolling 
bearing raceway present that the method is able to make 
reliably information prediction of a manufacturing system only 
with the current information of small size and without any prior 
information of probability distributions. 

Index Terms — Manufacturing system, Information-poor 
system, Regulation, Information prediction, Improved infomax 
method. 


I. Introduction 

In mass production, a manufacturing system must be preset 
for forecast and guarantee of quality of products to be 
processed [1-4] .The statistical approach is generally used in 
the process of regulation of the system. Because regulation 
and output information forecast of the system are conducted 
synchronously, the output information must be of a normal 
distribution along with the known standard deviation and 
coverage factor in advance. For an abnormal distribution or a 
new manufacturing system, information about the probability 
distribution, standard deviation, and coverage factor is 
commonly unknown or incomplete, showing that the 
statistical approach only relied on a normal distribution is 
invalid [4-6]. 

The infomax theory finds its position of strength in 
extraction of some information of the probability distribution 
of an information source [7-10]. In the field of information 
process, infomax means maximizing information in virtue of 
the maximum entropy criterion. But, the maximum entropy 
criterion entirely depends on rich information for evaluation 
of the probability distribution of an information source. 
Therefore, the infomax theory does nothing if poor 
information. 
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Poor information means incomplete information, such as, 
in system analysis, a known probability distribution only with 
a small sample, an unknown probability distribution only 
with several data, and trends without any prior information, 
and so forth [5-6] .The information-poor theory is a new 
theory that is able to settle the problem of information-poor 
systems by fusing many ideas of mathematics and mechanics, 
such as, statistics, fuzzy sets, rough sets, grey system theory, 
information entropy theory, chaos theory, norm theory, and 
bootstrap methodology [11-18]. 

During regulation of a manufacturing system without any 
prior information about probability distributions, only the 
current information vector of small size can be obtained by 
test cutting. Regulation aims at, based on the current 
information vector, predicting whether the future information 
vector of large size output by the system is in the interval 
specified in advance. It can be seen that the current 
information is characterized by poor information. 

With the help of the information-poor theory, this paper 
proposed an improved infomax method for regulation and 
information prediction of a manufacturing system with poor 
information. 

The improved infomax method consists of the bootstrap 
methodology, the grey system theory, and the information 
entropy theory. The bootstrap methodology is adopted to 
imitate the generated information vector of large size by 
bootstrap resampling from the current information vector of 
small size, the grey system theory is used to introduce the 
generated information vector into the grey prediction model 
for forecasting the future information vector of large size, and 
the information entropy theory is employed to predict a 
probability distribution of the future information via the 
maximum entropy criterion. Thus, regulation and information 
prediction of a manufacturing system may be put into practice 
under the condition of poor information. 

Experimental investigation on regulation and information 
prediction of the diameter and roundness of the tapered 
rolling bearing raceway is conducted to test the effectiveness 
of the method proposed. 

n. Improved infomax method 

A. Collection of Current Information 

Assume information output by a manufacturing system is 
specified within the interval [7 L , 7u], where 7 L stands for the 
lower limit and 7u stands for the upper limit. In the process of 
regulation, current information output by the manufacturing 
system is collected by a measurement system and the result is 
expressed as a vector X, as follows: 

X = (x(l), x(2),. . . ,x(n),. . . ,x(N))\n = 1,2,..., TV (1) 
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where X is the current information vector of small size, and 
x(n ) is the nth element in X, and N is the number of the 
elements in X. 

In (1), the number N of the elements in X is a small integer, 
and in generally, its values take in the range of [4, 10] for low 
manufacture costs. 

Based on the current information vector of small size, a 
generated information vector of large size can be imitated by 
the bootstrap. 


B. Simulation of Generated Information 

According to the bootstrap, B simulation vectors of size N , 
viz., the bootstrap resampling samples, can be gained by an 
equiprobable sampling with replacement form the current 
information vector X. They can be considered as a generated 
information vector of large size, as follows: 

0 = (0 1 ,0 2 ,...,0^,...,0 5 );Z? - 1,2,. ..,£ (2) 

where B is the number of the simulation vectors, 0 is the 
generated simulation information vector, and 0^ is the bth 
simulation vector that is expressed as 

& b =(0 b (l),0 b (2 d b (n),-A(.N)) (3) 

where is the nth element within 0^. 

In (2), the number B of the simulation vectors is a large 
integer, and in generally, its values take in the range of 
[1000,1000000] for accurate prediction of future information 
of manufacturing system with poor information using 
improved infomax method. 

Based on the generated information vector of large size, a 
future information vector of large size can be forecasted by 
the grey prediction model. 


C. Prediction of Future Information 

According to the grey system theory, the first-order 
accumulated generating operator (1-AGO) <& b of the 
generated simulation vector 0^ is given by 

= (%(1),%(2),..., % (/i),..., % (A0) (4) 

with 


<Pb( n ) = ^ 0 bU) 

j = i 

The grey prediction model is defined as 
d<p h (n) 


d n 


- + c bl <p b (n) = c b2 


(5) 


( 6 ) 


where n is regarded as a continuous variable, and c b \ and c b2 
are coefficients to be estimated. 

Let the mean vector be 

Z b =(z b (2),z b (3),...,z b (n),...,z b (N));n = 2,3,...,N (7) 

with 

Z b in) = (0.5 (p b (n) + 0.5^ (; n - 1)) (8) 

The least-squares solution to (6) with the initial condition 
<p b (l)=0 b (l) is 


%(# + !) = 


0 b i D- 


L b 2 

c bl J 


exp (~c bl N) + 


L b 2 
c bl 


(9) 


where rj b {N+ 1) is information of trend prediction for the 
generated simulation vector 0^, and the coefficients c b \ and 
c b 2 are given by 

(c bl ,c b2 ) J = (D t D) 1 dX;« = 2,3,...,n (10) 

with 


D = (-Z,I) t (11) 

where I is the unit vector of size N~ 1. 

According to the inverse AGO, the bth element of future 
information predicted is given by 

x b =r ?b (N+l)-r ]b (N) (12) 

It follows that the future information vector A predicted by 
the grey prediction model is obtained as 

A = (^,^,...,^,...,Ag) (13) 

Based on (13), the probability distribution of future 
information to be output by the manufacturing system can be 
forecasted by the maximum entropy criterion. 


D. Prediction of Probability Distribution of Future 
Information 


According to the infomax theory, the probability 
distribution of future information to be output by the 
manufacturing system should satisfy the maximum entropy 
criterion. 

From the maximum entropy criterion, information entropy 
H is defined as 

H=-J/(x)ln/(x)dx (14) 

Q 

where v stands for a random variable of describing future 
information, Q stands for the feasible region of x, and f(x) 
stands for the predicted probability-distribution of x. 


H max 

(15) 

along with the following constraints: 


J/(x)dx = l 

(16) 

Q 


x l f(x) dx = m t ; i - 0,1 ,...,M 

(17) 


Q 


where i is the order of the origin moment, m ? is the ith order 
origin-moment of x, and M is the highest order. 

In (17), the ith order origin-moment is given by 

1 B 

m i=fYu x ' b (18) 


Using Lagrangian multiplier method, the predicted 
probability-distribution can be obtained as 

f M \ 


f(x) = exp 




i=i 


(19) 


Put (19) into (16), and it can be obtained that 


JexJ 

O V i = 1 


dx = 1 


( 20 ) 


Solve (20), and the results can be obtained, as follow: 

f M \ 


6 ^ = j eX P 

Q V i = 1 J 


Q 

f 


„ i = 1 
M 


A 0 = -In 


1 J exp l LA* 1 

V i=l 


\ A 

dx 

^ J 


( 21 ) 


( 22 ) 


where f is the ith Lagrangian multiplier. 

Equation (21) can be calculated in the form of partial 
differential equation for A, and the result can be obtained as: 




le\t$en 

Research Publication 


96 


www.ijntr.org 


International Journal of New Technology and Research (IJNTR) 
ISSN:2454-4116, Volume-2, Issue-6, June 2016 Pages 95-100 


M 


-—2- = -J* x l exp A 0 + ^^A t x l dx = -m i (23) 

1 Q V i= 1 y 

Similarly, equation (22) can be calculated in the form of 
partial differential equation for 2 i? and the result can be 
obtained as 





f M ' 


x l exp 

2>' 

dx 

Q 

V i = 1 J 



(24) 


And then, equation (25) can be obtained according to (23) 
and (24), as follow: 


dA: /• I 



IH 

Z v 

dx 

Q 

l i = 1 ) 



m, 


( M \ 


f M \ 

j ex p Z'A r 

be - U exp 

X A ‘ x ' 

Q V i = 1 ) 

Q 

V i = 1 / 


(25) 


Finally, on the basis of (14)-(18), the values of the zth order 
origin-moment m ? of v can be obtained, after that, M equation 
sets can be established to solve the values of A 2 ..A M 
according to (25), and then the value of 2 0 can be calculated in 
line with (22). 

Based on the probability distribution f(x) of future 
information shown in (19), the parameter of future 
information can hence be predicted by statistics. 


E. Prediction of Parameter of Future Information 

In this paper, the parameter of future information includes 
the predicted true value and the predicted interval. 

According to the statistics, the predicted true value is 
defined as 

X 0 = | xf(x)dx (26) 

Q 

Let the significance level be ae[0, 1], then the confidence 
level P can be given by 

P = (l-a)xl00% (27) 

At the given confidence level P, the predicted interval [ X L , 
Xu] is defined as 

[X L ,X u ] = [X„ /2 ,X 1 _ a/2 ] (28) 

where X L is the lower bound, Xu the upper bound, X a/2 is the 
value of the variable x corresponding to a probability a/2, and 
X \- a /2 is the value of the variable x corresponding to a 
probability l-a/2. 


F. Reliability Analysis 

Under the confidence level P, the relationship between the 
predicted interval and the specified interval is as follows: 

igUlAuIcI/lJu] (29) 

After regulation is done, actual information output by the 
system should also satisfy (29); and if not, reliability analysis 
must be made. 

Assume the actual information vector is obtained as 
X A = (* a ( 1),* a (2 ),...,x a (s),...,x a (S))-,s = 1,2,. ..,5 (30) 

where X A is the actual information vector, x A (s) is the sth 
element, and S is the number of the elements within X A . 

Assume there are w elements within the actual interval [7 L , 
7u] of the actual information vector X A but outside the 
predicted interval [X L , Xu], then the reliability R of 
manufacturing system is defined as 


nL 
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xl00% 


(31) 


The value of the reliability R of future information about 
manufacturing system can be used for evaluation the result of 
prediction using the improved infomax method. The larger 
the value of the reliability R of manufacturing system is, the 
more efficient the improved infomax method is; and vice 
versa. If the reliability R >P, the result is reliable; or else, the 
result is unreliable. 


III. Case studies 

Two rolling bearing ring grinding machines are involved in 
case studies for grinding the inner ring of the tapered rolling 
bearing corded with 30204. One is the internal grinding 
machine and the other is the raceway grinding machine. The 
two are used to grind the inner ring bore diameter and the 
inner ring raceway, respectively, and the experimental 
investigation on regulation and information prediction to test 
reliability of the improved infomax method. 

A. Simulation Experiment for Information Prediction of 
Bore Diameter 

The probability distribution of the bore diameter after 
grinding is considered as a normal distribution in the 
simulation experiment. 

Elements of simulation information about grinding errors 
of the bore diameter are simulated by means of the simulation 
model based on the normal distribution with the 
mathematical expectation of 0 A and the standard deviation 
of 0.1 A. The number of elements is 1024, and the 2014 
simulation information elements are constituted an 
information sequence X 2 oi 4 , as shown in Fig. 1. 

The former 5 elements of X 20 h are selected as the elements 
of the current information vector X (N= 5), corresponding to 
sequence numbers from 1 to 5 of the simulation information 
sequence X 20 i 4 , and the later 1019 elements of X 20 h are 
selected as the elements of the actual information vector X A 
(5=1024-5=1019), corresponding to the sequence numbers 
from 6 to 1024 of the simulation information sequence X 20 i 4 . 

The actual interval [7 L , Iu] of the actual information vector 
X A is obtained by the statistics, as follow: 

[/ L , 7u]=[-0. 19769, 0.18686]. 

According to the bootstrap, let £=10000. The generated 
information vector 0 of size Ax£=50000 is simulated 
according to the bootstrap resampling from the current 
information vector X of size N= 5. Based on the generated 
information vector 0, the future information vector A of size 
£=10000 is predicted according to the grey prediction model, 
and the result is shown in Fig. 2. 

With the help of the information entropy theory, let the 
highest order M be 5. According to (14)-(18), the values of 
the ith order origin-moment m t of x are obtained, and the 
results are 

{mi, m 2 , m 3 , m 4 , m 5 }={-0. 29809, 0.99164, -0.55897, 
2.28190,-1.55168}. 

And then, M (M=5) equation sets are established according to 
(25), the values of A u 2 2 ..., 2 5 are solved according to the 5 
equation sets established, and the results are 

Ui, 2 2 , 2 3 , K 2 5 }={-0. 50472, -0.22257, 0.10711, 
-0.06341,-0.00789}, 
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and the value of 2 0 is calculated according to (22), and the 
result is 

2 0 =1. 08453. 

Based on the future information vector A, the probability 
distribution f(x) of future information about manufacturing 
system is predicted in the light of the maximum entropy 
criterion and the result is shown in Fig. 3. 



but outside the predicted interval [ X L , Xu] and hence, it is 
obtained that the value of the reliability R of manufacturing 
system is 

#=( 1- 0/1019) xl00%=100 %>P. 

B. Practical Experiment on Information Prediction of 
Raceway Roundness 

By grinding and measurement after regulation of the 
machine, information of the raceway roundness, in pm, is 
collected and the result is as follows: 

1.08 0.90 1.06 1.28 0.88 1.87 
1.16 1.06 0.97 1.01 0.70 1.15 
0.72 1.08 0.67 1.10 0.98 1.15 
1.14 1.64 0.73 0.87 1.91 1.95 
1.19 0.78 1.51 1.39 1.39 

and the above information collected of the raceway roundness 
is constituted a information sequence X 29 , as shown in Fig. 4. 


Sequence number 

Fig. 1. Simulation information sequence X 2 oh of bore 
diameter 




n 


Fig. 4. The collected information sequence X 29 of the 
raceway roundness 


Fig. 2. Future information of bore diameter 



x 


Fig. 3. Probability distribution of future information of 
bore diameter 

Using the improved infomax method proposed in this 
paper, let the significance level a=0.05, and then the 
confidence level P= 95%. Based on the probability 
distribution f(x) of future information about manufacturing 
system, the predicted true value X 0 and the predicted interval 
[X L , Xu] are obtained, respectively, and the results are 
X 0 =-0.015, 

[X L , XuH-0.202, 0.211]. 

Obviously, as shown in Fig. 1, there are not elements within 
the actual interval [/ L , I\j] of the actual information vector X A 


The former 6 values of X 29 are selected as the elements of 
the current information vector X (N= 6), corresponding to 
sequence numbers from 1 to 6 of the collected information 
sequence X 29 , and the later 23 values of X 29 are selected as the 
elements of the actual information vector X A (S= 29-6=23), 
corresponding to the sequence numbers from 7 to 29 of the 
collected information sequence X 29 . 

The actual interval [/ L , I\j] of the actual information vector 
X A is obtained by the statistics that is 

[/ l ,/uM0.67, 1.95]. 

According to the bootstrap, let #=10000. The generated 
information vector 0 of size Xx#=60000 is simulated by the 
bootstrap resampling from the current information vector X 
of size N=6. Based on the generated information vector 0 , the 
future information vector A of size #=10000 is predicted by 
the grey prediction model and the result is shown in Fig. 5. 

With the help of the information entropy theory, let the 
highest order M be 5, the values of the ith order 
origin-moment m t of x are obtained using (14)-(18), and the 
results are 

{mi, m 2 , m 3 , m 4 , m 5 }={-0. 66228, 1.13472, -1.20998, 
2.52210, -3.12965}. 

Then, M (M= 5) equation sets are established according to 
(25), and the values of A u 2 2 ..., 2 5 are obtained by the 5 
equation sets established, and the results are 

U 1? A 2 , A 3 , A 4 , 2 5 }={-l. 25214, -0.03375, 0.28821, 
-0.10344, -0.02185}, 


A 
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and the value of 2 0 is calculated according to (22), and the 
result is 

2 0 =-0.49900. 

Based on the future information vector A, the probability 
distribution fix) of future information about manufacturing 
system is predicted in the light of the maximum entropy 
criterion and the result is shown in Fig. 6. 



b 

Fig. 5. Future information of raceway roundness 



x/pm 


Fig. 6. Probability distribution of future information of 
raceway roundness 

According to the improved infomax method proposed in 
this paper, let the significance level a=0.01, and then the 
confidence level P= 99%. Based on the probability 
distribution fix ) of future information about manufacturing 
system, the predicted true value X {) and the predicted interval 
[ X L , Xu] are obtained, respectively, and the results are 

Xo=1.12, 

[X l ,Xu]=[0.49, 2.15]. 

It can be seen that there are not elements within the actual 
interval [/ L , 7u] of the actual information vector X A but 
outside the predicted interval [ X L , Xfi and hence, it is 
obtained that the value of the reliability R of manufacturing 
system is 

R =(1- 0/23) xl00%=100%>P. 

Case studies above present that the improved infomax 
method is able to make reliably regulation and information 
prediction of a manufacturing system only with the current 
information vector of small size and without any prior 
information of probability distributions. 

As a result, the proposed method in this paper can be 
considered as one of complements for the existing infomax 
theory in use. 

Mechanism of the improved infomax method is production 
of the future information vector of large size by means of the 
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bootstrap and the grey prediction model based on the current 
information vector of small size and is prediction of the 
probability distribution with the help of the maximum 
entropy criterion relied on the future information vector of 
large size. 

IV. Conclusions 

The improved infomax method is able to make 
reliably regulation and information prediction of a 
manufacturing system only with the current information 
vector of small size and without any prior information 
of probability distributions. 

Mechanism of the improved infomax method is 
production of the future information vector of large size 
by means of the bootstrap and the grey prediction model 
based on the current information vector of small size 
and is prediction of the probability distribution with the 
help of the maximum entropy criterion relied on the 
future information vector of large size. 

The proposed method can be considered as one of 
complements for the existing infomax theory in use. 
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